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The scoring sheets were evaluated, and the score was 
used to place students in a rank order. Statistical analysis 
of the rank order provided an inter judge reliability coeffi- 
cient of the three adjudicators and a correlation coefficient 
of each adjudicator’s ranking with a pre -determined actual 
ranking. The scoring technique, which was thought to be most 
promising and which the adjudicators seemed to prefer, was 
re-evaluated with the recordings of twenty flute players. 

Findings : 

Statistical analysis of the rank order indicated that 
the interjudge reliability of all three audition techniques 
was significant at the .01 level of confidence. When the 
rank order of each adjudicator for each audition technique 
was compared with a pre-determined actual ranking for each 
instrument, all but one of the correlation coefficients were 
significant at the .01 level. The coefficient of the one 
exception was significant at the .05 level. 

An analysis of six individual performance characteris- 
tics (tone, pitch, rhythm, technical accuracy, musicality, and 
sight reading) indicated that the evaluation of musicality 
produced the most reliable ranking. A survey of preferences 
of experienced adjudicators In the State of Texas indicated 
that they felt musicality should receive the largest weight 



in evaluation. 
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Purpose of the Study : 

The primary purpose of this study was to develop a 
means of evaluating student performance in auditions for fes- 
tival bands which would minimize the inconsistencies of sub- 
jective judgment. Present audition conditions were studied 
in order to determine not only types of methods being used 
but also criteria for the construction of a scoring sheet 
which could be used under present organizational arrangements. 

A secondary purpose of this study was to stimulate 
interest in further research in the area of musical perfor- 
mance evaluation. 

Procedure : 

The design of this study was of an experimental nature. 
The fact that no research report concerning audition technique 
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was found necessitated a pilot study which was conducted to 
test procedural methods as well as tape recording and edit- 
ing techniques. A survey of audition techniques being used 
in Texas all -region band auditions provided an opportunity 
for a comparison of different concepts. 

Three audition techniques were developed for use in 
evaluating tape recordings of students recorded on tape in 
live auditions. Two scoring sheets were constructed for use 
in the audition sessions. They were based on numerical and 
verbal description concepts which have been used for rating 
many areas where subjective decisions must be made, i.e., 
merit rating by management, attitude scales, etc. In the 
third audition session a recording of the audition music by 
a professional instrumentalist was used to provide a stan- 
dard of performance for adjudication. 

Three adjudicators were used to evaluate the recorded 
performance of students who auditioned for all-region band in 
Region II and North zone of Region IV of the Texas Music 
Educators Association. Recordings of seventy-seven students 
were divided by instruments: twenty flutes, twenty clarinets 

twenty cornet-trumpets, and seventeen trombones. Each adjudi 
cation panel evaluated the tape recordings of one instrument 
group three times using a different evaluation technique each 



time . 
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The scoring sheets were evaluated, and the score was 
used to place students in a rank order. Statistical analysis 
of the rank order provided an interjudge reliability coeffi- 
cient of the three adjudicators and a correlation coefficient 
of each adjudicator’s ranking with a pre -determined actual 
ranking. The scoring technique, which was thought to be most 
promising and which the adjudicators seemed to prefer, was 
re-evaluated with the recordings of twenty flute players. 

Findings : 

Statistical analysis of the rank order indicated that 
the interjudge reliability of all three audition techniques 
was significant at the .01 level of confidence. When the 
rank order of each adjudicator for each audition technique 
was compared with a pre-determined actual ranking for each 
instrument, all but one of the correlation coefficients were 
significant at the .01 level. The coefficient of the one 
exception was significant at the .05 level. 

An analysis of six individual performance characteris- 
tics (tone, pitch, rhythm, technical accuracy, musicality, and 
sight reading) indicated that the evaluation of musicality 
produced the most reliable ranking. A survey of preferences 
of experienced adjudicators in the State of Texas indicated 
that they felt musicality should receive the largest weight 
in evaluation. 
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A re-evaluation of the second audition technique with 
a different adjudication panel produced an equally reliable 
ranking of student performances. Adjudicators were able to 
use the continuum concept very efficiently, and a minimum of 
time was necessary to instruct them in the proper way to mark 
their evaluations. 

Conclusions : 

1. The three scoring techniques developed in this 
research provide a reliable means of scoring musical perfor- 
mance evaluation. 

2. The second technique was preferred by most of the 
adjudicators; and although not statistically more significant 
at the .01 level, the coefficients seemed to be a little 
higher. 

3. The performance characteristic, musicality, was the 
most consistent factor in determining the rank order when com- 
pared to tone, pitch, rhythm, technical accuracy and sight 
reading . 

4. The graphic evaluation scale concept can be used 
effectively to score and rank instrumentalists who audition 
for festival bands. 
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CHAPTER I 



INTRODUCTION, PROBLEM, AND DEFINITION OF TERMS 

I. INTRODUCTION 

Today in the secondary schools of our country, students 
are involved in many activities. Some of these activities are 
concerned with group participation, while others involve 
individual students. The high school band is one of these 
activities in which students perform as a group and also as 
individuals. Contests and festivals for these band students 
are provided by statewide interscholastic league organizations 
state music teachers associations, colleges and universities, 
and many area, regional, district, and local groups. 

Band contests and festivals have provided the bands 
with an opportunity for performance as well <. 5 a means of moti 
vat ion toward excellence through competition with like organi- 
zations. Music directors were able to recognize the values 
which could be derived from contests and festivals early in 
the development of music competition. In a symposium on 
contests and festivals conducted during the 1936 convention 
of Music Educators National Conference, C. Stanton Belfour 
gave the following appraisal of the contribution the music 
contest makes to instrumental music organizations: 

Any survey of the American musical scene reveals 
the important role of music contest to the community. 
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The joy of achievement is response to a challenge. A con- 
test of groups is one kind of challenge to any community. 

It has been found from experience that the "state-wide 
community" offers the solution for the field of inter- 
school contests. Rural areas can best be grouped into 
the county unit to serve as the community for recognition 
of achievement. . . . From the ranking of players to first 
chairs in sections of bands and orchestras to the ranking 
[rating] of school units representing their respective 
communities- -town, township, city, county, district, and 
state- -the stimulus afforded by contests has brought 
Bach, Beethoven, Brahms, and the others of the glorious 
company of craftsmen to many communities which, without 
a contest program, would be denied opportunities to 
achieve .-*• 

The motivation of an award for an outstanding perform- 
ance was a strong factor in the development of high musical 
performance standards in our schools. Many methods of awards 
were tried in search of a way to praise the outstanding bands 
and to encourage the bands which were of lesser ability. In 
the early years, musical organizations were awarded positions 
in a rank order when they performed, i.e., first place, second 
place, etc. This was changed in the early 1930’s to a rating 
system. Many rating systems were used and examined before 
the five -place rating plan was adopted in 1936 by the American 
Bandmasters Association, the National School Band Association, 
and the National School Orchestra Association. Some of the 
reasons for this change were given by Adam P. Lesinsky, who 
was at the time President of the National School Orchestra 



1 C. Stanton Belfour, ’’What Have Contests Done for Music 
Education?" Music Educators National Conference Yearbook 
(Chicago: Music Educators National Conference, 1936), p. 340. 
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Association. He stated: 

After ten years of participation in band, orchestra, 
solo, and ensemble contests, I still like contests. Many 
changes have taken place in this activity during these 
years. The bitter rivalry which existed between schools 
during the earlier days of contests has been transformed 
into a friendly competition. Directors, in the main, do 
not enter a contest any more with the idea of beating the 
other fellow. Their motive now is to have their work 
evaluated on the basis of perfection. The highest honor 
is no longer limited to one individual or group. Just as 
it is possible for more than one person in an algebra 
class to make an n A, M so it is possible for more than one 
individual or group to make a first rating in the music 
contest, where the rating system of judging is used. 

The rating plan for evaluating the concert band, solos, 
and ensembles has proven to be successful and is still being 
used in most festival- contests today. However, students must 
still be ranked for seating in their own band or a festival 
band for which they are auditioning. Since only one student 
can be the first chair player in each section and since most 
band directors seat students in bands according to their per- 
formance ability, a ranking system must be used. 

The recognition for progress in musical development is 
a strong motivating factor to the young instrumentalist. The 
student who auditions for a place in a festival band should 
be assured that the many hours of practice which must be spent 
in preparation for an audition will be carefully and accurately 
evaluated. In most cases the rankings given at an audition 



2 Adam P. Les insky, "The Festival-Contest," Music 
Educators Nat ional Conference Yearbook (Chicago: Music Educators 
National Conference, 1934), p. 276. 
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are carefully determined. The majority of the adjudicators 
who rank these students are honest and sincere in their evalu- 
ations . 

William E. Whybrew made the following remark in the 
conclusion of his book, Measurement and Evaluation in Music : 

Evaluation of musical performance probably never 
can be entirely objective due to its very nature, but 
systematic procedures can improve the reliability, and 
thus the validity, of such appraisals. It is to be hoped 
that clear definitions of standards and further research 
into procedures will help to effect still greater improve- 
ment . * 

This research was designed to provide a study of auditioning 
procedures and an evaluation of audition techniques. 



Statement of the problem. Every year in the State of 
Texas alone, approximately 50,000 secondary school band stu- 
dents participate in auditions for festival bands. These 
include all-district bands, all -region bands, and many pri- 
vately sponsored festival bands. In these festivals the 
students audition for a position in the bands, and are placed 
in the bands by rank according to the results of the auditions. 
In such auditions the students must depend on the subjective 
judgment of the adjudicators to evaluate and rank them. 



^William E. Whybrew, Measurement and Evaluation in Music 
(Dubuque, Iowa: William C. Brown Company, 19^^jjTT77 . 
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Many methods have been tried in search of a fair evalu- 
ation of students' performances in auditions. For example, 
one method that has been employed has required two or more 
musicians to evaluate a student's performance in an audition, 
thus limiting the individual subjectivity of one adjudicator. 
This method has improved the reliability factor of the evalu- 
ation, but has not provided the desired result. Whybrew stated: 

The best tool for evaluating musical performances 
seems to be a kind of rating scale which will help auditors 
[adjudicators] to systematize their judgments and also aid 
in ensuring that all auditors [adjudicators] evaluate a 
performance on the same basis, i.e., give attention to 
the same elements of performance and weight the elements 
in the same way. 4 

Whybrew gave this analysis of the current methods of 
evaluating musical performance: 

Evaluation of performance is of necessity subjec- 
tive. Too frequently, applied music exams and auditions 
are rated rather haphazardly through general impressions. 
More systematic procedures are needed in order to produce 
more reliable evaluations. ^ 

The fact that a large number of students in secondary 
school bands audition each year for festival bands almost 
demands that music educators construct a method of evaluation 
which will effectively evaluate student performance. The sub- 
jective nature of these judgments makes this task difficult. 

The lack of research done in this important area is appalling. 



4 Ibid . , p. 166. 
5 Ibid . , p. 173. 



